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Figure 'TRIAL 1 . 
The program analyses this scene and finds 3 bodies: 
(BODY 1 IS :1 :6 :2) 
(BODY 2 IS j 11 :12 ;10) 
(BODY 3 IS ik :9 ;5 :7 -3 rS :13) 
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SECTION OME: IHTRODUCTTOH 

ThLs wewarsndum describes a program which finds bodies In a scene* 
presumably formed by 3- dimensional objects* with some of them perhaps 
not completely visible. 

When SEE"the pretentious name of the program— ana lyses the scene 
TRIAL (see figure 'TRIAL'), the results arc 

(BOB? t. IS :6 :2 :1) 

(BOD* 2. IS :11 :12 :10) 

(BOOT 3. IS ;4 :9 :5 :7 ;3 ;8 :13) 

NIL 

SEE looks for 3-diraensionsl objects in a 2 -dimensional sc*ne; the 
scene Itself is not obtained from s visual input device * or from an array 
of Intensities or brightness; rather , supposition is mad* that a pre-pro- 
cessing of some sort has taken place, and the scene to be analyzed is 
available in a symbolic format (to be described soon). In terms of points 
{vertices), lines (edges), and surfaces (regions)* 

SEE does not have a pTe -conceived idea of the form or model of the 
objects uhicb could appear In a given scene , the only supposition being 
that they are solid objects formed by plane surfaces; in this way, it can 
not find "cubes" or "houses 14 in a scene, since it dots not know what a 
"house" is. Once SEE has partitioned a scene into bodies, some other pro- 
gram , probably a matcher* will work on then and decide which of those 
bodies are "houses*" 

Therefore, SEE forms a welcomed link between a preprocessor [1, 2} 
which transforas intensity pictures Into point or line pictures (*) , and 
a recognizer (such aB TD [3] or OT [£>])> which handles this line picture 
and finds bodies, objects or zones matching with certain patterns or 
models. Instead of searching through the whol* scene looking for parts 
to match Its models > the work of the recognizer (**) becomes simpler after 
SEE has partitioned the scene into bodies > because the data to be searched 
(matched) Is smaller and better organized* 



(*) A description of these processes in analysis of scenes is given in [5]* 
(**) Assuming the recognizer is interested in bodies whlth SEE can see (see (51) 
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The analysis which SEE makes of the different scenes is generally 
acceptable s although in Bcane ambiguous cases It tiehaves rather conservatively. 
Distributed over these pages y the reader will find examples of scenes 
analyzed *by SEE 4 and the peculiarities and behavior of the program will 
"become clear. 

The program SEE is written in LISP* and has "been tested in the FDP-6 
machine of the Artificial Intelligence Group, Project MAC- A preliminary 
version v&s written in CONVERT, and was extensively used for quick test of 
ideas vhich shaped the -_:>? z-grsn to its actual form- 
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SECTION TWO: INPUT FORMAT 

The next section "Format of a Scene 1 , describes the fonn in which SEE 
expeets the Bcene to bej eventually, this data will come from a visual 
input device (vidissector) s through a pre-processorj nevertheless t for 
testing; purposes, the scenes are entered by hand in a simplified foncat 

(called input format )> and then some routines produce from it the necessary 
data for utilization by SEE. We will describe both in this section, which 
may be — together with the next one — skipped by the reader without much 
loss of continuity. 

Exansple of a Scene; Suppose we want to describe the scene 'CUBE 1 . We begin 
by giving (in LISP) a value to 'CUBE* 
(SETQ CUBE (QUCCZ (A 1. 1. ( : I E t k G) 

B 1.0 5.0 (si E =2 C :b A) 

C 3.0 7*0 (;2D :h B) 

D A.(] 7*0 (:S E :3 F :k C) 

E 6.0 5.0 (:2 B :1 Q :3 D) 

F 8.0 3.0 (:3 G ik D) 

G 6.0 1.0 (si A :k F :3KB] 

») 

Following each vertex 3 we give its coordinates and a list, count ere loclcwise 
ordered, of regions to which that vertex belongs and vertices to which that 
vertex is connected;, in the next section this list receives zhe r.ame 'KZtfD' , 
and is rare fully described. 

•The conversion of the scene ^ as Just given, into the fora which SSE 
expects, is made by the function LLENA; thus, (LLEHA CUBE) will put in the 
property list of CUBE the properties BEGI0NS and VERTICES; in the property 
list of each vertex, the properties XCOR, Y00R a HBEGIOHS* HVERTICES and KIHD; 
in the property list of each region , the properties NEIGHBORS and KVERTICES, 
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Then, ve evaluate {FOOP (GET (QUOTE CUBE) (QUOTE REGIONS)}), which puts 
the property FOOP to each region. All these properties are descrihed in detail 
in the next section. 




Figure 'CD BE'. A scene. 

Finally, we perform 

(MAPC (FUNCTION (1AMH3A (X) 

(FUTPROP X (QUOTE BACKGROUND) (QUOTE BACKGROUND)))) 
J Pl.Tr'ROp (QUOTE CUBE) (QUOTE ( ; k ) ) (CfJOTE BACKEROOHD) ) ] 



We now give a more complete example. The following is the file' TRIAL LiSP; 
when loaded, it puts the scene TRIAL (see fig. 'TRIAL') in the fori* which 
SEE expects. 
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SECTION TKRZEj FORMAT OF A SCENE. 

As said before ^ the input to our program is a scene in a special symbolic 
format, which we proceed nov to describe. 



The Scene and its Components.- A scene is fundamentally a collection of 
vertices and regions. 

A scene has a name which identifies itj this is an atom, vith its property 
list containing the properties "REGIONS*, 'VERTICES', and ' BACM5BOUHD r . ?or 
exacipl*, the scene ONE {see figure 'ONE") has the name "ONE 1 . In the 
property list of "ONE 1 ve find 

R3QIQBS — £?1 :£ :3 A :5 t€) 



VERTICES 



bac?:q?!u[J}d — 



(A B C E E P G H I J K) 
06) 





Unordered list of regions 
composing the scene ONE, 

Unordered list of vertices 
composing the scene ONE. 

Unordered list of regions 
composing the background 
of the scene GHE. 




Figure "OBE 1 . A scene. 
Vertices and surfaces (regions) 
are the main components of a scene. 
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Region*- A region corresponds tp a surface limited by a simply connected 
curve. For instance, in DUE, ABC Is a region* called tl, out GIJKDE 
is not. 

Each region has as name an atom which possess additional properties 
describing different attributes of the region in question* These are 
, 5ETGEEORS , J ' KVEHFKES p T and 1 POOP r . Pot example, the region in scene OWE 
formed "by tlie lines AE> 2D, DK, KC 5 C , has ' :2' as naae* In the 
property list of :2 ve find: 



rrcT(;rari.;:! 



{:3 zk 16 :1 :6) 



KVE3T ' 



[D E A C K) 



Counterclockwise ordered 
list of all regions neighbors 
to ;2* Poor each region, 
this list is unique up to 
cyclic permutation- 

Countftrclockvise ordered 
list of all vertices which 
belong to the region :2* 
This list iB unique up to 
cyclic permutation- 



r'DO-' 



{:3 D zk E 16 A :1 C :6 K) 



Counterclockwise ordered 
list of alternating neighbors 
and kverticeB of :2< 
This list is unique up to 
cyclic permutation « 

For a region (say :2), POOP starts with any neighbor region (say ^3), 
continues counterclockwise -with the vertex belonging both to that region and 
that neighbor {in our example, D; it belongs to :2 and :3)» continues 
— counterclockwise allweys — vith the next region ( :k) s the next vertex 
(E), the next region {:6) + etc* 

HETGHBORS and K7ERTICES are then easily derived from FOOP: take the odd- 
positioned elements of FOOP, and its even-position*d elements, respectively* 
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The POOP property of a region Is foT»ed hy a man vho walks on its 
boundary having all ways this region to hia left* and takes note uf the regions 
to his right and of the vertices which finds in hie way. 




Figure 'ONE'. 
Repeated here for convenience. 



As another exaraplei the property list of the region zk (see fig. ORB) contains: 
NEIGHBORS — (:5 -.6 :6 :2 ;3) 
EWM1CSS — (G F I H) 
FOOT — (;5 G :6 7 :6 E =2 D r3 H] 



Vertex-- A vertex is the point where two or more lines of the scene meet; 
for instance * A, G and K are vortices of the scene ONE. 

Each vertex has as name an atom which possess additional properties 
describing different attributes of the vertex in question. These are 'XCOR' 



(see scene OME) has In its property list! 



XCOR 
YCOR 

■vertices 

keegioms 



3,0 
15.0 
(1 G D) 

<:3 ;5 ;b) 



For exaaiple, the vertex H 

x— coordinate 

y-coordinate . 2-dimensloBal - 

Counterclockwise ordered 
list of vertices to which H 
is connected- (**) 

Counterclockwise ordered 
list of regions to which H 
belongs (**)* 



^7 



Places where his path changes direction or /and the region to hia right 
changes name*. 



*» 



'This list is unique up to cyclic pormutation. 
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KIKD — (:3 I :5 G ih D) Counterclockwise ordered 

list of alternating nregions 
and nvertices of H (**). 

For a. vertex (say ft), KIND starts with any neighbor region (say :3) , continues 
counterclockwise (around H) with the next vertex (l in our example) , then the 
next region ( : 5 ) » etc . 

The KOTO property of a vertex Is foreoecl toy a man vho stands at th* vertex, 
and, vhile rotating counterclockwise* takes note of the regions and vertices 
which he sees, 

MRBGIONS and HVERnCES are then easily derived from KIME: taJee the odd- 
positioned elements of KITO, and its even-positioned elements, respectively. 

As another example, the property list of the vertex B contains: 



xco? 


~ 


1-5 




tco?: 


--. 


3.0 




VERTICES 


— 


(7 A D> 




HREGIOHS 


— 


tth »6 -2) 




KIKD 


— 


(ik ? :6 A 


:2 D) 



this list is unique up to cyclic permutation. 
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SECTION FOV i : ': • ■ - DT VOTI'ICES 

Vertices are classified according to the slope, disposition and number of 
lines which form it. The function (TYFEJGEmtATOR L) , where Lisa list of 
vertices, performs this classification, putting In the property list of each 
one of the elements of L, the type to which it belongs. 

The TYPE of a vertex is always a list of tiro elements; the first is the 
tyr^e-namc : one of 1 L' , 'PORK 1 , ■ ARROW 1 f >T' > 'K 1 , 'X 1 , fc FEAK' 4 'MULTl'; the 
-;*:j:_:[;:.t iLi*-j;-:J is the cat -arc ; ger.ara 1 .1 -• L* i liflt, Hfa&fie for- varies with the 
type-name , and contains information in a determined order about the vertex in 
question. 

We now proceed to describe the different types, their type-names and datum. 

Vertices where two lines meet* 

L.— A vertex formed by only two lines is always classified as of type 'L 1 . 

Two angles exist at it, one bigger and other smaller than 180 . The datum is 

a list of the form 

(E TL ) 9 where EL is the reglcr. vhi r:h ecnt-a'-ns 

the angle smaller than lfiO° fc 

EL is the region which contains 

the angle greater than l80°, f ' : : 

For instance, in scene CROSS (see fig. ^CROSS*), 
Q has In Its property list: 

TYPE — CL {;8 :9)) 

The vertices of type L present in CROSS 
are A, F, H» I ? J, 0, Q, 




1,.. 




Figure 'CROS S r . 
used as &n example 



Vertices vherc three lines ncct. 



FORK.- Three lines meeting at a point and forming angles saaller than IflO 
for» a FORK. 

Its datum is the vertex itself 
at vhich the fork occurs. For instance > 
vertex H has in its property Hat 

TYPE — (FQB3C N) 

The vertices of type FORK present 
in CROSS are H ■ 

ARROW-.- Three lines meeting at a point* with one of the angles bigger than l80 . 

The datum of as ARUOW is a list like 
(^ £ £ E. B^ Eg Eg E.J vherc J- 

Sj is the vertex at the 'tail 1 , 

E2 is the vertex at the center* 




E3 is th« irertax at the left! 
E^ is the vertex at the right. 
2c is 'the region at the left. 



l*> 




* With r aspect to segment E^*- E 2 - 
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I* Is the region at the right 



IL is the region which contains the angle "bigger than l8C . 

For instance, vertex E h-ES in its property list 

TYPE — (AEEOW (D E P G il r2 :9)) —fig. CROSS,— 

!Ehe vertices of type AEROW present in CEOSS are S, E, K. M, 



■P.- Three concurrent lines, of which tvo are colinear. 
The datijm for a T is a list of the form 
EL is the vertex at the 1 tail r of the T. 
EL is the central vertex * 
EL is a vertex such that 2L E ? E^ is 
an angle "between 90 and 180 degrees. 
Si is a vertex such that EL E p E^ is 



(E 1 Eg Ej E fc E Eg E.J, where 




an angle smaller than 90 degrees . 
That ia s E-. & E p are colinear* 
Ej. is the region which contains the 
angle between 90 and l80 degrees. 
E>- is the region which contains the angle smaller than 90 degrees. 
E- is the "central 1 ' region { where the 180 angle ls) + 
For instance, vertex B~tfig; CROSS) has in its property list 

TYPE — [T (C R Q A ;S :T :9)) 
The vertices of type T present in CROSS are B, L, R, 



Vertices where four lines meet. 



K.~ Vhen tvo of the vertices are colinear with the centar, and the other two 
fall in the same side of audi & line. The datum is a list of the form 
(E. 2L E~ E. E- Eg E- Eo) where 

E. is the central region . 

Eg Is the region having the l80 angle. 

E^ is the colinear vertex which falls 2 
to the left of EL E . 

E^ the region to the left (of &%-**i) 

E 5 the vertex to the left (of Fy-*E a ^ 




IS. 



E^ is the colinear vertex which falls to the right of E. E p * 
EL is the region to the right of £)-*h ■ 
Efl is the other vertex to the right (of E,) + 
For example, we find in the property list of G the following(see fig. CROSS f 
type — (K (:3 :2 C tt H R :9 B)) 

G is the only vertex of type K present in scene CROSS. 

X.- When two of the vertices are colinear vith the center, and the other two 
fall in opposite sides of such a line. The datum is a list of the form 
(&L E 2 Z^ E^ S ? Eg), where 

E- is one of the colinear vertices. 

EU is the region to the left of 

vhere C is the vertex at the center. 

E~ is the region to the right of T. * 

Ei is the other colinear vertex. 

B_ ie the region to the left of E* C 

B^j ie the region to the right of E^ C. 
For instance, we find in the property list of P: 

TYPE — {X (N :6 :Jl Q rfi :?)) 
The vertices of type X present in CROSS are C s P. 

The datum for an X may also he in the form (Ei E_ E>- E. E_ E.) t 

Vertices of four lines uhish ar* r.r..± i"/' "r.^t^ K : " :r - ftr* t-j I n^r cf 
type PEAK or MULTI. 



E x C, 




Other types of vertices. 



PEAK.- Farmed hy four or more lines , when the YCOR of the central vertex is 
"bigger than the YCORs oF the other vertices* 

ft 



PEAK 





MULT : 



MULTI. ^ Vertices formed 'by four or more lineB* and not falling in any of the 
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The datum for vertices of type FEAK is of tne form E^ vhere 

E_ is the region which contains the angle bigger than 180 degrees. 

The datum fgr vertices of type MULTI is of the form E. , wtaere E. is 
th* Tertex itself. 

Here is now the funetion(TYPEGEBiaiATOIl L}, vhere L is a lift of vertices. 
JcfMOP TY a E3E<E*AT£H (L^aDA <A» 

t LAM 30 A tN] >' 

I <LM3fl* (- SL3* KIN13) 

iLisr iqjotc d clist <i <j}| i 

\1 (LIST OUOTE L> 

tLlST (CAR <|ND> CCAOUR <N0IU 



) ] I 



I < £U L 6*1 
<C0VD UESUAlI (CADR SL3P) ICAOOO* Sl£J*») 
(LIST (QJ0T£ TJ 

(LIST *6 N <4 <2 <5 <1 <3}}t 
KE3JAL1 CAD* Su3 3 J iCaDS S ] > 
(LIST (QJOTE T) r | 

(LIST <d N <2 <6 K3 <5 <lUt '-" 
U£3U*L1 ICAUCD* SL9*1 CCADff 51) 
(LIST iOJOTE n .| 

1LIST <2 M <b -la <i KJ <SI)I 
(4E3JAL , . 

ISETU L ■ ~" " . 

i*JST (CR3SS* *2 N <d HI 
ICRj5S° <* \ <6 HI 
[CROSS 9 K6 ft «2 M) j ] 

<juars it t nil ""• 

(LIST (QjttU FORK) V) > 
4 lE*UAL L UU3TE iT f IMH 
<L1SF CSJOTE ARKOi^t i 

(LIST <4 N K£ <fi <J <5 <lf|"j 9""^ 
f (ESUAL L ItiUDTE <T M m ) 
(LISI IQJOTE A*K3*» 

(LIST <2 N «6 \A Kl <J <5>M 

hesuaw l cdjors en r nil 

1 Li S I 4GJOTE ARSa*i! : 

<L1&T <€ M «* <2 KS <i <3* t J 
< T EPRX1T i i 

(LIST l KIND v OJQTE E9R341 lltjl' 

< IEui L S, 1 
i-QVD ((E3UAL1 <CAljP SL3*] ICADUD* iuJ*)) 
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SECTION FIVE: THE PROGRAM 

As already mentioned, the recognition program called SEE accepts a des- 
cription of ai scene expressed In the notation Jvst described, and produces 
as output lists containing the identification of the bodies present in 
the scene. 

In this section ve describe the prograa, and how it achieves 

its goals. We hegin with a couple of examples 

Example 1. Scene r IIT This scene (see figure r II r J Is analyzed toy BEE, with 
the following results: 



(LOCAL ASSUMES { i5) (=13:1*0 SAME BODY) 

(BOUT 1- IS :1 :3 ;2 ;16 ;17) 

(BODY 2- IS :k :l6 ;15) 

(BODY 3. IS ?T :6 :11 :12) 

(IQDY 1*. IS :9 rB ;10) 

(BODY 5. IS :13 :lU :5> 

(BODY 6. IS ;20 :19) 



Results for scene 'II' 
(see next page) 



Example 2. Scene r BRIEGE< .- With this example, we give the- details of the 
operation. We start hy loading into LISP the following files [currently, free 
microtape GUZMAfl *); 



(UREAD SQRT LAP2) fQ 

(R0OAP T) 

(UREAD SEE 25) f ft 

i UREAD GENERA 10) fQ 

(UREAD BRIDGE SCE33) fQ 



Square root, defined in LAP 

Kill LAP 

Read SEE 

Head auxiliary functions 

Loading of this file cfctf£S2 
seen* BRIDGE to be read &n the format 
described in Section Two) afid transformed 
to the proper form which SEE expects 
(&s described in Section Three). 
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Figure 'II'* 
This scene ia analyzed by SEE, with 
results detailed ta Example 1* 
ALL bodies are correctly found. 
Son* o£ the vertices appear in the. 
drawing with their names; in other 
"Jrawings'we will "generally omit "chfrm 
we are also o*nit±ng th* coordinate 
£xis. 

■■ . 



',■■' 



■ 
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{SEE (ftUOTE BRIDGE)) 

We call to SEE „ with the name 
SEE 2? ANALYZES BRIDGE of the scene, 

FILLSCEHE Different parts ctf the progran 

print their n&me &.=. they are 
CLEWf entered. 

EVIDENCE 

LOCALCTIDEffCE 

GIOML 

({NIL) {{:S} C0017 00015 GODlfc G0013 GQ012 GOOll) ((=T> G0022) {{:10) GQ023 etc. 

LOCAL 

(LOCAL ASSUMES £ tlfl.) (:19) SAME BODY) 

(LOCAL ASSUMES ( =2o) (:29) SAME BODY) 

(LOCAL ASSUMES i:10) (:B ill : 5 ;6 ;M SAMK HOC':' ) 

(LOCAL ASSUMES (:?) (:& ?11 =5 :6 :4 :10) SAME BODY) 

((IfIL) ((;8 :11 :5 :6 A ;iO ;?) 00013 GOOlfc G0011 G0017 O0012 G0013 00020 etc. 

LOCAL 

(SIHGLEBODY ASSUMES (sl9 llQ) ( =16) SAME BODY) 

((( :2k :9 :21 ;27 ;12 ;2?) G00I3 G006Q GOO56 G0054 GOO*tp G0033 GO0£9 G0057 etc. 

LOCAL 

SES'JLTE 

(BODY 1. IS :2h : p ;21 ;27 ?lg :2?) 

(BODY 2, IS *.Z2 .26 ;£3) 

(BODY 3. IS :17 -3 :M) 

(BODY k„ IS :1 ;2) Result* for scene 'BRIDGE 1 

(BODY 5* IS :1k :15 Sl3) 

(BODY 6, 15 :19 =iB ll6) 

(BODY 7- IS :S9 :2fl) 

(BODY fi. IS :& :11 :5 *6 =1* !lO ;7) 

NIL 

Unnecessary detail has toeen removed from the drawing*; ttoe reader siuat bear in mind 

that the complete scene contains vertices (whose names do not appear in the drawings} 

and their coordinates vith respect to axis which are also not shown „ lines —edges — 

and surfaces —regions — . 



2-4. 




Figure "BRIDGE 1 , 
The long body :25 ;24 iZ7 :2L :9 :12 i* 
correctly identified. 
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Ho« the progran works.- Th* operation o£ SEE is quite straigh forward; che 
program is Little recursive, and does not do any seaTch, Ite main parts, 
which are executed one after another, unless otherwise indicated, are: 



FILLS CEHE;.- The properties SLOP and TYPE are generated, for each vertex, if 
they were not already present. 



CLEAH.- Old properties used internally by SEE are removed! from vertices and 
regions - 

EVIDENCE.- An analysis ia made of Trertices, regions and associated information* 
in search for clues that indicate that two regions form part of the same body. 
If evidence exists that two regions in fact belong to the same body, they are 
linked or marked with a gensyw ( lf both receive a label of the sasae color"). These 
links faay b& strong (global) or weak (local). 

LOGALEVIDENCE - - Some features of the scene will weakly suggest that gone group 
of regions should be considered together* bs part of the same body. This paTt 
of the program puts these * local' links or evidences * 



GLOBAL.- The "strong 1 links gathered so far Are analyzed; regions are grouped 
into "nuclei " of bodies, which grow until some conditions fail to b* satisfied 

(a detailed! explanation follows later). 



LOCAL-- Weak evidence is taken into account for deciding which of the unsatis- 
factory global links should be considered satisfactory , and the corresponding 
nuclei of bodies are then joined, to form a single and bigger nuclei , 
Assumptions made by LOCAL arc printed (see output of SEE)- LOCAL may call GLOBAL 
again, or go on. 



SINGLEBQDIES.- If a single region does not belong to a bigger nucleic, but is 
linked by one strong evidence to other region, it is incorporated into the nuclei 
of the last one. This part of the program may call GLOBAL or LOCAL again, If 
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necessary, or go on. 'SINGLEBODIES ' also prints its assumptions. 

RESULTS.- The regions belonging to the background are screened out, and the 
results are printed. 

Example ♦ Scene TOWER.- At this point I want to go into considerable detail 
to explain each one one of the parts of SEE that have been sketched above* 
This section is in^ortant because it will help to understand the behavior of 
SEE, it? strength and dcfficienccs* 

First, we begin by showing a tjrpical analysis of SEE with a soneuhat 
camp-licated scene (see fig. r TOVER f ), 

The output is 
SEE 25 ANALYZES TOWER 
CI£AN 
EVIDENCE 
LOCALEVIDENCE 
GLOBAL 

((NIL) ((:20) G0O55 G0054 G0053 GO052) <(:19) G0059 G0056 etc. 
LOCAL 

((NIL) (:20 ;19 *21> G0055 G0052 G0059 G0056 G0054 G0053) ((* etc. 

LOCAL 

<((;3 :2 :1) G0077 G0OS9 G0079 G0078 GO076) ((:5 :15 :4) GOQ49 etc 

LOCAL 

RESULTS 

(BODY 1. IS :3 :2 ;I) 

(BODY 2. IS :5 ;15 :4) 

(BODY 3. IS :23 :17) 

Results for TOWER (see next page) 
(BODY 4. IS :6 :7 :S) 

(BODY 5, IS :10 :11 :9) 

(BODy 6. IS :13 :14 :12> 

(BODY 7, IS jlB :22) 

(BODY 8. IS ;20 :19 :21> 

NIL 
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Figure F T W E R f - 
Neither LOCAL or SINGLEBODIES are necessary 
to correctly parse this scene into the 
bodies which form it* Ther* arc plenty of 
'fltttiog 1 links in this scent t and SEE makes 
good use of them« 
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FILLSCEHE. CLEAN.- These two parts of SEE are simple; if neceBsaTy, FILLSCEHE 
calls SLGPGEHERATOR and TYPE<2TCIERAT0R; CLEAH removes some unwanted properties, 
The beginning of the definition of SEE thus looks like 

IDE ? .»*DP SEE <_A*I3DA fS'l ,-«-, „, / & 

^&j?P (« 1*1,1 CE.S_ ,Kf3J_0NS SLOP TYPE BODIES U LEV BACmotfa^Jlt*' 

(*RgTP fli itfg^j ARTIES llTiTTTr 
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(SETO SI.0P IQJ3TE SLD°U (SETS TYPE «0UQT£ TfPEH 
(S£TQ I YijJT.lCES <SET S (iUOTE VERTICES) U 
<S£.TQ 9*CKBftOJND rSST SCENE ( OUOTE "BAC<e»3 JND I >) 

jCOND ((NULL (SETO ^ESIOfcS (SET S (QU01E a£313NS)M)« >k 

: . C«ETUJtN (Ml " . J& . . ;->t» 

:;:l.tCLEAR < GO *I LL3CE»EV>' <T iQOCLEAMJ)) 

FILLSCENE (P*INT cau'DTE FrLL&CE~t(i£ I fl lsfCtf»3E'4ERAt9R fE*»CE6& 

m'*EB£N*R*T0* tfERUCEBl,. <SET3 ClEaR 1(1' CLEAN'*' . :"''S | ' 

ifRlNf (QUOTE CLE*!*}* " "f CLEAN fjff l'cft""tfufftf "^itt'E >T ' ^^J 

. MMFRD" S IOJ0TE »3DEE&n' TCLSA* REBtdilS JDJOfE 33Dro» 

(CttAN LESIONS (OJOTE 'S&LYTl '"' 
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IJJNCTI3N <LA1B0A <J> I *IH»>RQP J.CA.DS J) t^OTV'^^jjfe 



<SETfl TEI < ; ) 
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EVIDENCE-- Stronfc or global links are placed bythis part of the program* Two 
functions are used; EVEHXICES and TJOIHTS* 
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EVERTICES.- This function consideres each vertex of Che scene, under the 
following rules; 

L*- Vertices of the type 'L' are not considered. 

FORK.- If three regions meet at a vertex of the FORK type, and none of them 

is the background, links between them will be forned* For instance* in 

fig. TOWER we establish the links ;19-s20j :19-;21, *20-:21* Bevertlie 

less, some of these linka to&y not be produced: 

in the figure at the right, the link between 

:3 and :2 ia not produced because Q is a "passing 

T" ; the link between il and ;2 ia^ produced. 

The link between ;1 and :3 is not generated 
because R ia an 'L 1 . 
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This ±a a powerful heuristic* and (see fig. 'BRIDGE') allows us, 
for instance, to omit the link between regions :5 and t9 in scene 
'BRIDGE 1 . Nevertheless * this same heuristic puts a link among regions 
*S and :9 o£ the same scene. As we shall see Late** this is not 
too bad. 
ARKOW#- This type of vertex causes two of its regions (the 'left 1 and the 
'right' one) to be joined; In the figure of the right, we will put 
a link between ;1 and :2 , which 



;1 



i2 
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Arrow links :L and :2 



X: tto links established. 



counts as evidence that :1 and 
l2 belong to the same body* 
Nothing is said about :3. 

For instance, is this type 
of vertex that joints :1 and :2 
in figure 'BRIDGE 1 . 
Km- Two cases are distinguished; 

a) The X is fonsd by the 
intersection of two lines. No 
evidence is formed* 

b) Otherwise iiojts : i- : 2 
and :3-:4 are formed (see fig. 
at the right). This second type 
of X occurs when we have piles 
of objects i fox instance, in 
fig* TOWER, ;L8 and ;22 are con- 
sidered as belonging to the saw 
body, due to this type of vertex. X: two links established. 

PEAK.- All its regions, except the one containing the obtuse angle t are 

linked to each other* See fig. COBN. 
T + - We first look for another X to match the vertex currently analyzed - f 
two T'a match if they are colinear 
and "facing each other"; the closest 
pair is chosen, if several. For 
instance, A and B are paired (fig- at 
the right)* An indicator 'tfKCTE' is 
placed in such vertices ,. 
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Matching Ts. 
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a) Once the flEXTE is determined, ve establish a link between rl 
and x2 —last figure" and another between :3 and ;4* These links 
wiLl not be produced if the result of them 1b to associate 
the background with something which is not the background. 

b) The following test is done* If neither the left or right region 

(!L or :2 in figure at right) Is 

the background f but they have It 

as a neighbor, and in some part 

of the boundary of xl and :2 with 

Che background j the Begr&cnt which 

separates these is parallel to the 

central segment of the T, then 

:1 and ;2 are linked. 

For Instance, In figure T I I*, 

this analysis applied to the vertex 

T will produce evidence that :13 

and :14 belong to the same body 

(£A - AA P X - HA and OA - HA 

are parallel)* This is a rather glcbal 
heuristic although only usenu. Tor 
bodies vith parallel faces. 
Also, EVERTICES classifies T r s 
according to the slope of their central 
segments, storing thea in the form 
(3,5 60001) (-10.666 G0002) ,♦, > The numbers arc slopes, and the 
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A lick ia established between 
;I and ;2 because they do not 
belong to the- background 3 
but this is a neighbor of both 
of them, and the segment that 
separates :1 of the background 

(and the same is true for :2) 
is parallel to OP, the central 

SLieijLint: of ! <■■ T in question. 
(B is the ba2k£rou>id). 



TES ■ < 

gensyms contain under property 'FAS T a list of dafcumg of Ts having that slope. 

TJOHJTS.- T^s function actuates on TES and establishes global evidences a* 
described in part a} of x. (top of this page). 



IA3CA1EVIDEHGE*- A leg is an arrow £f one of £j B left or right vertices is a 
corner (if necessary, through a chain of matched Tea) vhtch has a side parallel 
to the central segment of the arrow. The function LEGS finds legs in the scene , 

and stores this inf-j ■.:.:. ;*-- lis-: of 've-iJ:* linr.s. 
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Figure 'LEGS'. 
Three different types of lega. 



T-be definition of the function (LEGS N), where N is a 



vertex 



f qUovb . 



(A* 



■ 






■ 



i 









R3? LESS [ v* MBA * <N| 

(E3 (CA* (SET3 J (SET n (QUOTE HPE M M 

(SETS J (CAQR Jl \ 

(OR (AND (SETS M (CORNER [ C ADR. J) ^(C ADD 
(DR (»AR4_LSL (CADRUr'TcIft 
(&AR (SET ** 1 BOOTS MVER.T1C 
C'ARAuLEL <CA"0» Ul "< 6'* ft 
(CAD* r5ET N 1QUDTE 'JVEfif 
(**fl (3ET3 M tr0ONERfC*U'4"«>'<'C'*00D 
(Oft l*MH£tL tC*DS U> (CAR 
(CAR 13ET N (OJ'JTE NYERTI 
< B ARA<_LEl (C*!V* J) ICAR 
(CAD* [©IT H (a^DTE WERT 
.SETS J (CDDDD* U)l (LEV (C»» J» <C*D' 



i* 






--::• • 



(QUOTE aRRQh'i ) 

U) N 
ESMU 

U) N ..,■•• 

ISE&MtM) ■ tf- 
R UJ h 
U] N 

cesiVm 

U) SI 

ICES) J 111 iff 

■ 



ui>h 



■ 



DE^'^DP GQR&E* < L. A M 3 Ll * 

• rHjrT=s tc*R «T) 
ma'.ic** isErs is 












tl (SET & C5JDTE TY*£) 
l"SJOTE Tl)J N| Vj 



H) iaU0T£ D) 3? ' 




EX** 



(go i&aflp* *n hi 



CO* NEK * [C4tfDfl&" t 



. .-V 
TSjTF£n»lMI : | g 

nmV . :- 



33* 

GLOBAL.. - Strong evidence is analyzed in this part of the program When- this section 
is entered » several links {strong and weak) exist among the different regions of the 
acene. These links are shown pictorially in figure 'LINKS', for the scene 'BRIDGE' 
(gee both). All the links to the background (:30) arc deleted; the "background can 
not be part of any body* 

Pefinition a a nucleus (of a body) is either a region or & set of nuclei which has 
been formed by the following rule. 

Rule : If two nuclei are connected by two or more links » they are merged into 
a larger nucleus by concatenation. 

(Two nuclei A and B are linked if regions a and b are linked where acA and bcE) 4 
For instance, regions :fl AJld :11 are put together, because there exist two links 
among them, to form the nucleus :8 - 11. How, we see that regicn zk (see fig. 'LINKS' ) 
has two links with this nucleus s8 - U, and therefore the new nucleus :8 - 11 - lU 
ia formed. 

We let the nuclei grow and merge under the former rule, until no new nuclei can be 
formed. When -..':ri-i. Io l\,r. ::u:.*, the scene h£.s been psr-itioned into several M UAXi»&l" 
nuclei \ between any two of these* there are zero or, at nost, one libit* For exeaaple, 
fig. 'LINES' will be transformed into fig. 'NUCLEI .'. 




Figure 'MUCLEI ' 
{See fig. 'LINKS' first 

on next page ) . 
After Joining all nuclei hcving two or sore links in ccmmon > 
the representation for the scene 'BEIECE' changes frcm xhat 
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Figure 'LINKS 1 

This figure represents scene 1 BRIDGE' „ with the strong links between 

its regions (represented here toy circles) shovn. The dotted links 

represent the evidence generated by the vertex PB (see BRIDGE). 

The abort arrovs show the links put toy vertex JB; note that a lint 

between :5 snd **9 is not put, because 5 (see fig- BRIDGE) is a passing 

t- joint. Zig-xag links Are produced by the aneehaniem described in 

part b) of T. (page 31 )♦ 

Curled links are produced by vertex GB; even ±f this vertex were 

occluded, and the links missing^ there is still enough evidence to 

identify regions :k :5 and :6 as belonging to the same body. WEAK, limes *« ftcfcsnouit- 

See text. 
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LOCAL. - If same (strong) link joining two "maximal' 1 nuclei- is Also reinforced 
^y a weak link, these nuclei are merged. 

For example, in scene BRIDGE (see fig. 'BRID3E 1 ) the following local links 
exist (among others): :7 to :U; ;10 to :k- t :2B to :29; rlQ to ;19. 
There fore s the corresponding nuclei are merged and now figr MUCLEI looks like: 




r £0 




n 



o 




Fig. 1E« NUCLEI ■ 

The figure shows the acene 'BRIDGE' , after LOCAL trans forms it 
fr--: z'n-2 rcprcuLriLuLlcij in lit> 'KUCL^I r Lo thfi Gfie shown here, 

A veak link does not cause the regions which it links to be merged or considered 
as "belonging to the sane body, unless there is in addition one strong evidence among 
5ii:-h r-2.gic-p.5- LOCAL may call GLOBAL ng&in, if necessary, 

SIHGLEEODIES. - A strong link joining a nucleus nr.d another nucleus composed by a 
single region is considered enough evidence and the nuclei in Question merged, if 
there is no other link emanating of such single region. For instance, in fig. 1 MEW 
NUCLEI ' , nucleus :l6 is merged with nucleus ;l6 - 19 (see fig. 'FINAL 1 }. Nucleus 
:28 -29 is not Joined with r£6 - 22 - 23 or with s 2*1 - 25 - 27 - 12 - 21 - 9- Even 
if nucleus :28 - £9 were composed by a single region, still will not be saerged, since 
two links emerge frcw iti two nuclei oleiE its possession- 
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Figure 'PINAL', 
SING1EB0DIES joints the lonely 

region ;l6 vtth the nucleus : 16-19- 

■i * 

The definition of the function (SIffGLEBODIES B) is given nov, where S is a 

list of nuclei » each one having the form ( (IL R o *4 ' " ^ ^1 L 2 L 3 L l* *»•)* 

the Rs are regions forming i ! . ri'--:: ::j<- i .~:is a and the ^ rire link?, Jgensyas) 
emanating from that nucleus. 
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RESULTS,- Screening r out t^f. regions that .belong to the "background* the nuclei 
are printed as "bodies/ 1 

ftESJuTS "(=»RJ>T fc <eJOTE.R£SJLTSM iS-TO J 0) 



(0* fWUtL IC»» J) ) <h=m 
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■ In this process, we ignore the links which may be joining sane of the 
nuclei ; RESULTS considers the links of figure 'FIItAL" , for instance, 
non-existent . 

DISCUSSION 

Division of the evidence in two kinds, strong and weak, seems to be 
a good comprcmise. Since SEE requires two strong evidences to join two 
nuclei , I believe it will lie in the "safe" side, that is, SEE: will almost 
never Join two regions that belong to different bodies. Rather, the mistakes 
of SEE are of the other kind; some times, regions that should be Joined 

are left separate's., 

When there is ambiguity in the scene % SEE behaves conservatively. We 
will h&ve an opportunity to see this in the results of the analysis of 
some of the scenes that follow. 

The purpose of the 'weak' links is to reinforce, if necessary, the 
strong links- 
More heuristics could be added to increase the ntuaber of links; in par* 
ticular* given a good number of "link proposers 1 ', parameters set outside 
(by the user) would tell SEE which set of heuristics to usej for instance, 
if v* knew that the scene is forned "by prisms, we could use the heuristics 
that ask for parallel lines having a given configuration, ve could check, the 
length of certain edges a etc. None of this is incorporated in the actual 
SEE program. 
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SOME IHTSRE£7i:M EXAMPLES 

We present in this section several scenes with the results as computed 

by SEE, 

Example, 'CORN 1 *- The program analyzes the scene CORN (see fig, CORK} 
obtaining th* following identification of bodies: 

{SIBGLBBODY ASSUMES (:2 :3 :1) ( :*0 SAME BODY) 

{BODY 1. IS :2 j3 :1 :fc) 

{BODY 2, IS *7 :6 :5) 

{BODY 3. IS :13 til :12) 

(BODY It. IS slS Jlfi :1b) 

(BODY 5- IS Jl9 tl6 :17) Results for 'COM' 

(BODY 6. IS :£1 iSO) 

(BODY 7. IS ;8 :9 flOj 

NIL 

The region ;*J got a single link with :3j and SIHGLEBODY had to join it with 
the nucleus :1 :2 j3, Note that :h and :12 did not get joined. The pyramid 
at the top was easily identified "because its peak produces a lot of links. 

Example . 'MOMQ 1 .- (see scene t HQMD') The results are as follows r 
(LOCAL ASSUMES (M7) {:&) SAME BODY) 

(LOCAL ASSUMES ( :p :1T) f:lfi) SAME BODY) 
(BODY 1. IS :3 r2 si) 

(BODY a. IS :32 :33 :27 :S6) 
(BODY 3- IS :£S J 31) 

(BODY b, IS :19 :20 :3l* :30 :29) 

(BODY 5* IS :36 :35) 

/^„» *■«,«! ^ M n Results for 'MOW'. 

(BODY 6. IS :2« t 5 :21 ;«) 

(BODY 7. IS :25 :23 :22) 

(BODY 8, IS !l* tl3 :15) 

(BODY 9. IS :10 :l6 :11 :12) 

(BODY 10. IS :l8 :9 :17) 

(BODY 11. IS :7 ;6) 

(BODY 12. IS :38 :37 :39) 

MIL 




22 




CORN 



Since a. linK between :k and -12 is 
not established, the bodies found 
in that part of the scene are 
tl :2 :3 :*» and ill t!2 tl3. 
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Comments on %ht solution for 'MOMO ' : The central cubes are easily isolated. 

;2l gets a link with :5 and another with ,2h r so there is no need to use 

LOCAL in it. The same is true of ;£6 with s2T and 3 33. 

There is enough strong evidence to Joint ;£8 with :31- 

The links Tor :29 =30 :3h :20 :19 and :9 ill :l8 are as follows: 





The dotted links are due to the heuristic of parallel lines "between regions 

:3Q and :3k 9 and "between :20 and :19 (see page 40 ) . These links make possihhle 

to joint the otherwise disconnected nuclei :29- :3C- ;19 and e3^- :20. 

In particular, if :3^ or :£0 did not have parallel aides, SEE would have 

!>_" :*-:•} to -ut^X'- thess nuclei , and voul'fl have rsp-crted two bodies. 

The disposition of regions in HOMO is such that no link is present between 

:29 and :3l* s since 228 and :31 fall "exactly" parallel to :29 and :30. In 

a less extreme scene, some of these links would "be present, allowing 

correct identification even if :29-i3G-:3l4-:2D-;19 were not a prism. Anyway , 

SEE did not do any mistakes* 

The triangle of links formed by :9» slQ and :1T normally would have 
produced 3 separate todies (since we need at least one double link to merge 
two regions); nevertheless, in this case, LOCAL makes some assumptions and 
saves the situation* Again, if :9 were not a parallelogram, there would t>e 
no weak links between :9 and :16 or between s 9 and :17 3 and 3 bodies would 
have been reported instead of :£- 2l7- ; lS- But we should notice that, in 
general, two links instead of one would be between r!7 and ;18, 

Links were established between :1£ and : 13, vithout c 

bad consequences > That is because we need two mistakes 9 two wrong strong 
links^to fool to the program. Que chat could happen. 



r 



..-. 






■• -• ■ 




HOME 



J:\-r. hexagonal prisma lid r.ot cause "rouble; 
SINGLEBODY vas flooded to group :3^ with :33, 
The body : 38-39 vas identified as a single 
one, "but :l6-17 vas reported as tvc. 
Note that there does not exist local link 
between ;2l and ;£0j nevertheless, 
SINGLEBODY makes the correct identification. 
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Example. r HOMI',- (see scene HOME). The results are: 
(SHI&LEBODY ASSUMES (;33) (:3?) SAME BODY) 
(SH50LEBODY ASSUMES (;3U) (;33) SAME BODY) 
(SHCLEBODY ASSUMES (;£5 :2% :2£) (:23) SAME BODY) 
( SUBLEBODY ASSUMES (;20) (;2l) SAME BODY) 
RZSUIiTS 

{BODY 1. 13 :3 =6 :10 :2) 
(BODY 2- IS :lM :13 J 11 :12) 
(BODY 3. IS :9 :6) 
(BODY It, IS :1B) 
(BODY 5- IS :15 :?) 
(BODY 6, IS :3B =39) 
(BODY 7. IS :7 :26 :2?) 

(BODY 8, IS :2G :2l) Results for HOME 

(BCCY 9. IS :29 :28) 
(BODY 10. IS :3^ :33) 
(BODY 11. IS ;31 t32 :30) 
(BODY 12* IS :25 *2h :22 :23) 
(BODY 13* IS :l6) 
(BODY llj* IS tl9) 
(BODY 15. IB :1T) 
(BODY 16. IS :36 :3T :35) 

h:l 

Comments on the solution to HOME : There is certain degree of ambiguity in 
this scene, vhich huaan "beings tend to resolve by assuming y->aralleleplpeds , 
;16 and :17 &re reported as tvo separate bodies, instead of on*, which I 
think is & mora natural answer. 

In the picture from 'which 'HCffffi' vas drawn, :19 and ;l8 were the two 
faces of a Bingle parallelepiped leaning on :38-;39» SEE reports tl9 as 
one hody and :lfl as another* 

Nevertheless j SEE reports :3S and :39 && forming part of the same 
body X which was in fact the case in the picture in question), due to the 
fact that ik and :1 are background. 
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Example* '8 P R E A ]>',- The results are: 
(LOCAL ASSUMES (:36) (^) SAME BODY) 
(LOCAL ASSUMES (:30) (;31 :32 :29) SAME BODY) 
(LOCAL ASSUMES ( ;16") (;17) SAME BODY) 
(LOCAL ASSUMES ( ;5) ( :20) SAME BODY) 
(LOCAL ASSUMES (:3 :11 ;9) ( :12 :10) SAME BODY) 

(SIWGLBBODY ASSUMES (;S3) (i22) SAME BODY) 

(SIHGLEBODY ASSUMES (:1| :3<5) 037) SAME BODY) 

(SIHGLEBODY ASSUMES ({28 r26 ;27) (:25> SAME BODY) 

(SIHQLEBODY ASgUMfcS (:B) (:l8) SAME BODY) 

RESULTS 

(BODY 1. IS :39 ;^0 ;38) 

(BODY 3. IS :23 J 22) 

{BODY 3. IS :*»£ jbl) 

(BODY 4. IS :fc :36 ;37) 

(BODY 5. IS :2k) 

(BODY 6. IS :28 ;26 :27 i25) Results for SPREAD 

(BODY 7. IS :31 :32 ;2? :3Q) 

(BODY 8. IS :20 :5) 

(BODY 9. IS :12 :10 :3 ill t9) 

(BODY 10. IS :13 ;T =l) 

(BODY 11, IS :2L :6) 

(BODY 12. IS :Q :l8) 

(BODY 13. IS :1T :l6) 

(BODY Ik. IS -M -M :bk) 

(BODY 15. IS :19) 

(BODY 16\ IS :15 Jl 1 ") 

MIL 

Comments on the solution to SPREAD ? The hody : 22-23-2**, due to insufficiency 
of links, was split In two; ;22-23 and :2U. 

Since there is only one link "between :6 and :5, this hody gets split 
into two: :6-5 and : 21-20, Hote that :21 is not the sane face as :20, and 
there is where SEE gets confused and refuses to sec evidence toward linking 
:21 with :20. 

The long body :9-10-ll-12-3 gets properly identified. 




:lil and ;U2 ar* identified as s. aingls body. NevortheleBB „ iS-l&-19 
gets broken into 18-lS and :19* : 26-27*26-55 gets correctly 

Identir ed, ay '390X19 MM -Mv r""ur.r.y looking :£9-3ti-3»-3> : . 
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Example. 'H A R D'«- This scene is analyzed with the following results; 
(LOCAL ASSUMES fill) (tl2) SAME BODY) 
(LOCAL ASSUMES (:15) (:l6) SAME BODY) 
RESULTS 

(BODY 1. IS :12 :ll) 
(BODY 2. IS :l6 :15) 
(BODY 3. IS :32 ill ;30) 
(BODY If. IS :9 :10 :B) 
(BODY 5. IS :l8 :19 :20) 

(BODY 6. IS :13 : IT :li) Results for HARD 

{BODY T. IS :5 'M 
(BODY 8. IS :1 :S =33} 

(BODY 9, IS r24 =23 ;22 :3 =21 :2& :29) 
(BODY 10. IS :25 ;26 sST) 
(BODY 11. IS t7) 
(BODY :1S IS *.6) 
BIL 

Ccmnents on the solution to HARD ; ;15 and :l6 have to make use of weak 
evidence to get Joined and recognized as forming part of the same "body, 
nevertheless, this is not necessary with :28 and :29, "because, through & 
chain of Ts T there Is enough evidence in :3, :21 and :22 to join 
successfully all that long and twice occluded body. 

There is one serious "bug in this identification: regions :7 and :6 
get identified as two separate todies, and not as a single one, as one 
would normally do. This is caused "by the fact that neigher if nor :6 
have visible 'useful 1 vertices „ and there are not in them enough parallel 
lines to use the heuristic of page 31 ■ 

:33 was recognized as part of :l-2, as it should he. 
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HARD 

Body : 21-22-3-23-2 1 *-28-29 is reported as a single 
object, which is correct. Also* region s33 gets 
Joined with tl-2, as it should. Nevertheless, 
regions s7 and ,£ get reported as tvo bodies 
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